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Abstract 

We analyze the relation between the nonequilibrium Lagrange multipli- 
ers used in information theory and those used in Liu's technique to exploit 
the entropy inequality. In particular, we deal with some of the subtleties 
found in the analysis of the entropy flux. 

1 Introduction 

Lagrange multipliers play a central role in information theory and statistical me- 
chanics, not only as a mathematical tool to introduce a set of restrictions on 
the distribution function, but also because of their general physical meaning as 
intensive parameters. When one tries to use this technique in nonequilibrium sit- 
uations, the mathematical extension is not so complicated, in contrast with the 
subtle conceptual problems related to the physical interpretation of the nonequi- 
librium Lagrange multipliers. 

Furthermore, Lagrange multipliers are also used in nonequilibrium thermody- 
namics in the elegant method proposed by Liufl[ to take into account the restric- 
tions placed on the thermodynamic fields by the balance equations. Some years 
ago, Dreyerp showed that, under given conditions, the Lagrange multipliers used 
in statistical mechanics and those appearing in the formulation of nonequilibrium 
thermodynamics could be identified. This is of course an important question in 
order to relate microscopic and macroscopic results. 

Here, we deal with some subtleties which arise in the analysis of the entropy 
flux. Some of these subtleties, related to the role of (nonequilibrium) absolute 
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temperature |3], || in the definition of the entropy flux, were considered in || , both 
from the macroscopic point of view of Extended Irreversible Thermodynamics 
(EIT) -[12 1 and considering an information theoretical formalism. In the first 



case, an entropy flux of the form 



f - 1 (i) 



was assumed, where q is the heat flux and 9 the nonequilibrium temperature 
defined as the derivative of the generalized, flux-dependent specific entropy s(u, q) 
considered by EIT, with respect to the internal energy u. When this expression 
for the entropy flux is considered, one is led to an entropy production a s of the 
form 

= «T- V Q) - |- £> 0, (2) 

where a := — (9/ v) (ds/dq) and v = 1/p is the specific volume of the system 
whose density is p. The simplest evolution equation for the heat flux verifying 
the inequality (§), would be a generalized Maxwell-Cattaneo equation, namely 

rt =v (o)~j?> /i>0 ' (3) 

with a =: aq (this should hold according to the representation theorem, as q is 
the only vector among the independent variables and we should require that the 
equations reflect the isotropy of the system). 

However, one could add new terms to equation ([!]), what would merely modify 
the expression for the entropy production and, within this formalism, the allowed 
evolution equations for the heat flux verifying the second law of Thermodynamics. 
For instance, by using an information theoretical formalism a generalized entropy 
flux has been obtained in ||, namely, 

J» = f-|-Q, (4) 

where Q is the flux of heat flux and a and 9 are related to the Lagrange multipliers 
introduced in the formalism. When this entropy flux is considered, the entropy 
production arising from the evolution equation for the specific entropy would be 

a* = pi + V j» = f • V Q) - f • f-V > 0. (5) 

On the other hand, one can consider an evolution equation for the heat flux of 
the form 

q+V-Q=a q . (6) 
In this case, the entropy production would be 

a s = q-v(]-)-^^-v(^)-Q>0. (7) 
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Let us note that (0) can be written in the form (^), if it is assumed that 
Q = C, being C a constant tensor and 

* = -v (8) 

a \v J a 

(what will prove not to be convenient as it implies the assumption that W = 
V9(u, q) instead of 6 = 9(u, q)) or, otherwise, that 

Q = -u, (9) 

a 

3* = -^q. (10) 

a 

(but now we should assume that the product ad is a constant independent of u 
and q). However, in a general situation, it is not possible to write (|3]) in the form 

Now, we try to generalize the previous results by applying the technique 
developed by Liu |j] to exploit the entropy inequality. Let us note that, from 
this new point of view, we start by knowing the proper evolution equation for 
the heat flux (which can be derived, for instance, from kinetic a theory) and try 
to find restrictions to the form the specific entropy and the entropy flux may 
take. We will, thus, observe under what assumptions the previous results may 
be recovered. In addition, we should note that the information theory results 
obtained in M and Liu's technique are seen not to be equivalent in this situation, 
in spite of the results in 0. The reason will become evident in the following 
section. 

The plan of the paper is as follows: In Sec. 2, we briefly introduce the 
fundamentals of Liu's technique, while in Sec. 3 we apply such a technique to 
derive the form of the entropy flux and entropy production when a Maxwell- 
Cattaneo-like evolution equation for the heat flux is assumed. We will observe 
under what further assumptions the macroscopic results in || are recovered. In 
Sec. 4, however, we will consider an evolution equation of the form (|6|) instead, in 
order to compare it with the results obtained by using information theory. Sec. 
5 is devoted to the conclusions of this paper. 



2 Liu's technique to exploit the entropy in- 
equality 

The aim of thermodynamics is the determination of the fields Fi (i = 1..N) that 
constitute the state space Z of the system and are governed by balance equations 
of the form 

P^ + V.J* = o* (11) 
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where J Fl and a F% are, respectively, the flux and production of Fi and are func- 
tions of the state space Z. Such balance equations should be supplemented with 
constitutive equations relating the fluxes and the productions to the variables 
spanning the state space. If the constitutive equations were known, one would 
be able to explicitly solve the balance equations and obtain the thermodynamic 
processes. 

However, such constitutive equations are not known, so we need a method 
that may help us to obtain them or, at least, to limit their form. Liu's technique 
accomplishes this by the exploitation of the entropy principle in order to obtain 
expressions for the constitutive equations (or, at least, to reduce their generality). 
In fact, the constitutive equations must be of such form that they verify the 
following principles: 

1. the entropy principle 

2. the requirements of convexity and causality, which demand that the 
field equations be symmetric hyperbolic, and 

3. the principle of relativity. 

The entropy principle is a local expression for the second law of thermody- 
namics, written as an evolution equation for the specific entropy s (Z) 

P ^ + V-J S =cr S > 0. (12) 

at 

The entropy production o~ s must be positive for any solution of the balance 
equations. These requirements may be taken into account |3J by introducing a 
set of Lagrange multipliers A, (Z), such that 

p| + V-J 5 -E^(p^ + V-J^-^) >0, (13) 

for all continuous differentiate fields F^. By making use of the chain rule, equa- 
tion (|13"D may be seen to adopt the form 

and, as this expression must hold for any field, the terms in brackets must vanish 
so that 

m = x - ^ = A *W v " (15) 

Thus we can write 

N N 

ds = Y, \dFi, d.J s = £ (16) 

i=l i=l 
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and the residual inequality reads 



N 



E > o. 



;i7) 



i=l 



We should compare (jl6D 2 with 



TV 



j 5 = E^ 



in 0. Both expressions differ, while according to 0, information theory is equiv- 
alent to Liu's technique. The reason for such differences relies in the definition 
given to entropy. While in ||, entropy is defined according to Boltzmann's ex- 
pression, namely 

kB Jf\nfdT N , (19) 



S =- 



h 3N N\ 



in HI it is considered that 



S 
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/In +- 1--/ 1* 1--/ 



dY 



N; 



(20) 



where a = 1,-1 for fermions and bosons respectively and y is the degeneracy 
of the state. Let us note that from this expression we can easily recover (|l~9| ) if 
a = is chosen. The entropy flux is thus given in JJ] by 



J b = -k 



B 



/ln(^(l--/Wl--/ 



JJ , 



y 



y 



^2CidT N -idc 



N, 



(21) 



where Ci = Ci — v is the peculiar velocity of particle i, and if we take into account 
that / is a generalized canonical distribution function, namely 



./ 



y 



exp(£; XiAi) + a 



we can obtain 



s = J2 x i< A i> +kB ~J ln ( x + aex P (-E A ^)) dT N, 



and 



j 5 = E *iJ Al + kB lJ ln [ 1 + a ex P (- E X < A ^J ) E a^r^-idcjv. 



(22) 



(23) 



(24) 



Note that if we take a = in (|2~4"D, we recover equation ([TJ). However, if we 
evaluate the differential form 



5 



1 + a exp f - \ A 3j j E <3kdT N - X dc N , (25) 

the last term is easily seen to be equal to — J2i d\iJ Ai , so that 

df s = J2^dJ Al , (26) 

% 

independently of the value of a, as in 0. Thus, we observe that, although in 
the case of bosons and fermions the results obtained from information theory 
are coincident with those obtained by the exploitation of the entropy principle, 
one must be careful if classical particles are considered. This question should be 
further investigated as it is not convenient, neither can be guaranteed that 

Y,dX i T A * = (27) 

i 

for classical particles. 



3 Heat flux determined by a Maxwell- Cattaneo 
evolution equation 

Let us consider a system at rest submitted to a heat flux and verifying a Maxwell- 
Cattaneo evolution equation. Thus, the two evolution equations for the variables 
u and q spanning the space state are 

P^ + V-g = 0, |?+i(7+AVe)=0 (28) 

where r is the relaxation time of heat pulses, A the thermal conductivity of the 
material and the temperature of the system (we do not specify yet whether this 
temperature is the nonequilibrium temperature, as assumed in || or the local- 
equilibrium one, as usually done in linear EIT: we will consider both assumptions 
in the following). (|28|) 2 coincides with fl3|) as long as we identify 

The last two equalities are mere definitions of parameters as long as the first 
identification is performed. Thus, (28)2 is more general than (|J), because we 



have not already assumed what temperature G is. In addition, let us remark 
that, as commented above, (p^) 2 cannot be written in the form flllf ), unless we 
assume that VO is a function of the state variables. If such assumption is taken, 
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we can obtain 



and thus 



f ds . \ du ( ds r> \ dq dJ s _ , ^ x 

p {Yu- x -)m +p {o-q- x ^i + ^- Vu (30) 
+ I - A « u 1 : W- \^ (q + Ave) > o, 



(31) 



9s 


— X u , 


(9s 


<9w 


dq 


<9J 5 


= 0, 


df s 






du 


dq 



A U U, (32) 
- \ • - (q + AV0) > 0. (33) 

T 

In agreement with the representation theorem, as q is the only vectorial variable 
in the state space, we can write: 

J s (u,q) = V (u,q 2 )q, X q = A(u, q 2 )q, (34) 
s = s(u,q 2 ), X u = X u (u,q 2 ), (35) 

so the previous equations may be rewritten as 

Os ds A 

du~ = A "' W 2 = 2 ' (36) 

^ = 0, ^2gg + = A tt U, (37) 
and it can easily be seen that 

V? = \ u (38) 

is a constant, independent of the state variables. Thus we have 

s = X u u + F(q 2 ), J S = X u q (39) 

However, a constant temperature is indeed unphysical and furthermore it is 
not seen to be related with the temperature G appearing in the Maxwell-Cattaneo 
evolution equation, so the previous assumption that VO is a state function should 
not be considered. However, if we assume that = 0(2), we can write 



ds \ du (ds - \ dq / dJ s - p\ <96 
du U J dt \£?<f q ) dt 1 du q r du 



-r - A U U - X q P -— : V<f- A^g > 0, (40) 
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so that, if we define £ := pA/r, we obtain 



ds . 9s 
du 



A «> 1^ =A <?> ( 41 ) 



<9J S r ao 8J S , r ,96 

A g £— , — - = A n U + \ q £— , (42) 



du q du' 

-\--q>0. (43) 
r 

Again we can make use of the representation theorem 

J s (u, q) = (p(u, q 2 )q, X q = A(ii, q 2 )q, (44) 
s = s(u, q 2 ), \ u = X u (u, q 2 ), = Q(u, q 2 ), (45) 

and obtain 

Os 3s A 

Tu = K ' v = r (46) 



^=A«^, g;W+vV = KV + Ji(gm (47) 
ou ou aq l oq z 

The last equation splits into 



* = x » a? = ^a?" (48) 

Thus, the entropy flux is seen to adopt the form predicted in ([!]), that is (X u = 
I/O), 

J S = § (49) 



From (|47|) i and (^8|) 2 , we observe that cp is function of only, i.e. 

and thus, also A£. To proceed, we should make further assumptions concerning 
the temperature 0. 

• If we assume that = 0, that is <p = 1/0, we can write 

A « = -^ =» A = -^ = -^i- < 51 > 

so we recover EIT's generalized specific entropy: 



ds=d j-w^' dl (52) 



S 



The verification of the residual inequality, namely, 

a s = -\ q - ■ q>0 (53) 

T 

is guaranteed by the negativity of A = — rj (p\9 2 ). 

Note that no approximation has been performed and therefore, fl52|) is only 



limited by the validity of equation (28)2- Thus our procedure has been 



quite different from that adopted in usual EIT, where one departs from a 
generalized entropy and obtains a Maxwell-Cattaneo-like equation under 
the assumptions that a linear relation between fluxes and forces exists and 
that J s = q/9. Now, we have seen that if a Maxwell-Cattaneo evolution 
equation for the heat flux holds, the generalized entropy of EIT is the only 
possible one and the entropy flux must be given by equation ([[]). 

If we consider that O is the local-equilibrium temperature T, it must be 
independent of the flux q, so also must be 9, and, of course, 9 = T. Thus 
we should obtain an specific entropy of the form 

s = s eq (u) + F(q 2 ) (54) 

and A = A (q 2 ). If no further assumptions are made, £ = £(u, q 2 ) and the 
residual inequality implies, as before that A < 0. Thus, we observe that 
we can demand that the "physical" temperature appearing in the Maxwell- 
Cattaneo equation be the local-equilibrium one and thus, as suggested by 



Banach in ||13|| , the correction on entropy due to nonequilibrium situations 
must be additive and independent of the equilibrium variables. Let us note, 
however, that our requirement is much more restrictive than his. In fact, one 
of the problems of developing a extension of CIT by spanning the state space 
is determining which variables should be considered. One can always choose 
the nonequilibrium variables in order that the corrections to entropy do 
not depend on the equilibrium quantities. However, if equation ( p8|) holds 
and we have already chosen the heat flux q as the proper nonequilibrium 
variable, we have proven that ([54]) must hold. On the other hand, in |14| 



it has also been proposed, within the context of discrete systems, that the 
nonequilibrium entropy should take the form 

S = ! + F(©,© + , ©-,9, © + ,6r), (55) 

i.e. that out of equilibrium one can consider the generalized contact temper- 
ature as an independent variable (Note that the existence of three temper- 
atures 0, + and 0~ is a consequence of considering a discrete system and 
replace the temperature field). In this sense, the correction to the entropy 
does also depend only on nonequilibrium variables, although the first term 
also differs from its equilibrium counterpart, where becomes a function 
of U. 
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4 Heat flux determined by a general evolution 
equation 

If we now assume an evolution equation for the heat flux as given in equation 
(H), (note that such evolution equation arises for instance, when one integrates 
the Boltzmann equation) and considers that Q = Q(u, q) and a q = a q (u, q), we 
may write 



ds 



du 



dq / dJ s x dQ 



+ 



du "" J dt ' r \dq ' q ) dt 
df s . „ - dQ 



du 



Xn 



du 



Vu 



AnU - X q • 1 : Vq + X q -a q > 0, 



so we now have 



ds 
du 

df s _ ~ dQ 

du q du 1 



X u , 



ds 



A 



df s t dQ 

rs-, — X U \J + A q ■ "Tpr, 



\ q ■ o q > 0. 



Once more can we make use of a representation theorem to write 



J s {u,, 



(p(u,q 2 )q, X q = A(u, q 2 )q, 



a q = a(u, q 2 )q, 



(56) 

(57) 

(58) 
(59) 

(60) 



s = s(u,q 2 ), X u = X u (u,q 2 ), Q = a(u, q 2 )XJ + b(u, q 2 )qq{61) 

so the previous equations may be simplified and one obtains 
ds ds A 



du 



X u , 



dq 2 



dip \(® a ^ 2 \ ®^ \ 

du \du du^ J ' dq 2 



da db b 

1 q + - 

dq 2 dq 2 2 



(62) 

(63) 
(64) 



cp — X u + Abq 2 . 

Let us observe that the entropy flux we obtain is given by (we write X u = 1/0): 

I s = \ + Abq 2 q, (65) 
u 

while in IBI we had obtained 



J s = | + A(o + 6g 2 )^. 



(66) 
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Thus we can observe that in this concrete example equation ( p7[ ) does not hold. 
Note, in addition that, in equilibrium, Q is not null but isotropic, thus this latter 
expression will also differ from the usual local-equilibrium one, namely, J s = q/T 
and thus is not convenient. If we define 

q 2 

m := a + bq 2 , x := — , Ab := f, (67) 
equations (|62|) and (|63]) may be simplified and yield 



|=„-2,/, | = A, (68) 

§e = A^, £ = A^-/. (69) 
du du ox ox 

In order to obtain a concrete expression for the entropy of the system, we 
must solve this set of equations, taking into account that we must recover the 
equilibrium result in the case of null heat flux together with the convexity re- 
quirement for the entropy. Such requirement, namely, that 5 2 s > yields the 
following inequalities: 

<0, A<0, A + — 2x<0, 70 
ou ou ox 

OA \ fdA\ 2 
A + —2x - — 2x > 0. 
ox J \ou J 

If we restrict ourselves up to second order in the heat flux q, as both A and b 
vanish in local-equilibrium, we may take / = 0, so equations (|68|) and (|69|) reduce 
to 

du ^' dx ^' ^ 

du du ' 9x 9x ' 
and within this approximation the entropy flux reduces to (|I[) and m is a function 
of ip. 




5 Concluding remarks 

In this paper we have applied Liu's technique to the simple situation considered 
in |J, where EIT and Information Theory are applied to a system submitted to 
a heat flux q. Such a simplification allows to go beyond a linear approximation. 
We observe how by using Liu's technique, one can recover the results in usual 
EIT, but the procedure is quite different. As shown in ||, in EIT one assumes a 
flux-dependent specific entropy and a concrete form for the entropy flux, namely, 
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■I s = q/6, and thus one is led to a hyperbolic evolution equation for the heat flux. 
Now, the viewpoint is the opposite: we depart from a given evolution equation 
for the heat flux, and are thus led to a concrete form for the specific entropy an 
the entropy flux. 

On the other hand, we have considered a general evolution equation for the 
heat flux, namely 

§ + V-Q = ^, (73) 

and derived the corresponding form for the entropy flux and the set of partial 
differential equations whose solution allows the determination of the generalized 
nonequilibrium entropy of the system. We have also observed that our results 
differ from those obtained in ||, due to the definition employed for the entropy 
and entropy flux. Our present result, namely, 

I s = q/6 + Abq 2 q, (74) 

which reduces to J s = q/T in local-equilibrium, is thus much more convenient. 

Hence, we observe that there is not a complete equivalence between Liu's 
technique and information theory. This lack of equivalence is also observed when 
discrete systems are considered ||14j| . For such systems, one cannot usually write 
evolution equations for the fluxes, so by applying Liu's technique it is possible to 
prove that entropy cannot depend on them. On the other hand, if one assumes 
that the state of the system is described by the total internal energy U and the 
heat flux Q, information theory yields to an entropy which depends on both U 
and Q, in spite of the fact that no evolution equations neither for U nor for Q 
need to be included. This is due to the fact that we deal with such restrictions 
by maximizing 

-k B J flnfdc- Xu J fHdc- A Q J fQdc. (75) 

Thus, we see that there may be some subtle differences between the use of La- 
grange multipliers in usual information theory and in Liu's procedure. 
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